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Automated Quantitative Extraction 
Method of Aesthetic Impression from 
Color Images using the Tone in the HLS 
Muncell Color Space 



Toshinori Yamasaki, Tetsuo Hattori and Yukihiro Matsubara 

Faculty of Engineering ; Kagawa University 
Hayashi-cho, Takamatsu , Kagawa 761-0396 Japan 
Yamasaki (hattori, matsubar)@eng. kagawa-u.ac.jp 

The students acquire a visual literacy through learning the coloring 
systematically in the fine arts subject. This paper describes an extraction method 
for the aesthetic impression of the paintings based on the tone in the Muncell 
color space for fine arts subject. The impression, which the human being gets 
from the paintings, depends on the motif, the composition and the coloring. Here, 
we discuss the evaluation method of the paintings by the computer based on the 
tone that includes the lightness (intensity) and the saturation (vividness). We 
perform the evaluation experiment of the paintings that have a unique coloring. 
The evaluation result approximately resembles the impression of which human 
being is moved. This method is also useful for retrieving the image database 
using the ambiguous key words like the impression words. 

Keywords: aesthetic impression of paintings, color tone, color harmony, 
visual literacy, fine arts subject, image retrieval system 



1 Introduction 

Fine arts subject educates the ability of the sense beauty, that is, a visual literacy through recognizing a form 
and a color. For training such a visual literacy, it is important for the students to understand the nature of 
color systematically. Visual literacy that is the aesthetic judgment ability becomes the basis of the expression 
and the- appreciation activity in the fine arts learning. The students acquire the visual literacy by experience 
through repeated practice of painting the picture. On the other hand, there are the empirical rules about the 
composition and the coloring in the art. As for the color harmony, Ostwald, Muncell and Moon Spencer are 
well known. 

Recently, the multimedia database spreads widely with the development of the network technology. In the 
multimedia database retrieval, it is useful that we can refer database using the impression words and the 
ambiguous feeling words in addition to the key words. Recently, an image database retrieving by impression 
words as beautiful, balmy is reported [1-5]. 

/** ' 

We report the extraction way of the aesthetic impression degree of the paintings based on the Moon 
Spencer’s color harmony theory [6]. However, in the Moon Spencer’s way, we can estimate the degree of the 
beauty as the numerical value but we cam not know the detail impression like the dark, light, bracing 
impression which each painting gives. In this study, we describe more concretely the way of extraction the 
aesthetic impression of the paintings based on the tone in the HLS Muncell color space. 



2 The tone and the systematic color names 

We call a suitable coloring the color harmony. In the color harmony theory, Ostwald, Muncell and Moon 
Spencer are well known. Also, a color system is established by JIS (Japanese Industrial Standards) and 



PCCS (the Japanese Color & Coloring System). 



Here, we use the tone in the Muncell HLS space for estimating the impression of the paintings more 
precisely. We express a color by the word, which shows the impression of the color like the light green, the 
dark green. There is a difference between bright and dark, strong and gentle, vivid and muddy in the same 
color, same hue. We call this difference the tone (Lightness and Saturation). The tone is a concept of the 
lightness L and the saturation S being compounds and shows an impression of the color, which doesn’t 
depend on the hue well. As the tone has an each image, it is easy to connect the tone the psychological effect 
of the color. We can evaluate the feeling impression of the paintings by extraction the tone from the image 
data. In this paper, we adopt the PCCS tone for evaluating the impression of the paintings [7]. The PCCS 
defines the tone in the lightness L and the saturation S in the Muncell color space and gives color system as 
the tone and the hue. The PCCS classifies into 12 kinds of tones in each hue and packs the same tone of the 
every hue. Figure 1 shows the classification of the tone. 
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Figure 1 Tone (Lightness - Saturation) 



Figure 2 Systematic Color Names 



The tone image is defined by the systematic color names in the PCCS color system. The systematic color 
names is the color expression way that gives a modifier according to each fundamental color like white, red 
and blue. It sets a way of combining a fundamental color name and modifier. The modifier in PCCS includes 
an adjective, which shows the hue difference like the tinge of red, green. On the contrary, it has no word, 
which shows only lightness or a saturation. The bright impression includes not only the high intensity but 
also the vivid saturation. The mild impression means the high lightness and low saturation. Figure 2 shows 
the systematic color names of the tone space. 



3 Evaluation of the aesthetic impression 

After getting the image data through the scanner, we extract the impression feature of the paintings. Figure 3 
shows the outline of our method. The resolution and the size of the image data is 120 [pixels/inch] and 
640*512 [pixels] respectively. The image data is a full color, bit map. 

The image data has RGB color component and doesn’t connect with the color sense of the human being 
straight. Also, it is difficult to adjust the color tone in the color synthesis. Here, we convert the RGB to the 
HLS value in the Muncell color space, which fits for the color sense of the human being. Mucell color 
system shows the color as the three components, H (Hue), L (Lightness) and S (SaturationLgpd is used 
widely in the coloring. Figure 4 shows the Muncell HLS color space. We get the H[0,360], C[0, 1 ], S[0,1] 
values through the conversion of the RGB[0-255] value. 
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The number of the colors in the image data is enormous for processing data by 
a computer. Here, we reduce the number of colors to the degree, which doesn’t 
loose the color tone of the paintings. We divide the H, L and S to 1 0 and 
14 respectively. 
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Table 1 Maximum Values of L, S Figure 4 HLS Figure 3 Outline of the 

Muncell Color Space Extraction Process 

The maximum value of the L and the S depends on the coloring material and each hue shown in table 1. 
Therefore, the value range of the L and S is different according to each hue. For example, the maximum L, S 
value of the Red and Purple hue is 8.5, 14.0 and 8.0, 1 1.5 respectively. Here, we normalize the L, S value 
0-10 ranges. 



From the above way, we estimate the number of the pixel in the S-L tone space through mapping the image 
data to the tone space. We can find the aesthetic impression of the paintings by estimating the position of the 
mapped pixel in the tone space because of the correspondence between the tone space and the impression 
modifier shown in figure 2. In this experiment, we evaluate the number of the colors, which accounts for 70 
% of the color area. However, we cannot estimate the impression because the distribution in the tone space 
becomes apart. Here, we calculate one position of the tone space from several distributed positions using the 
weight coefficient of each tone position. 

S^WiSi, L = W i L i (1) 

Where Wi = Y*( a i^L a t) O a * is the number of the occupied pixel in each color. 

We estimate the impression of the paintings according to the tone index (S, L) defined in equation (1). 



4 The evaluation experiment 

The simple coloring picture is tested beforehand. As a result, the showy picture of the pure color and the 
gloomy picture are mapped over the v (vivid) and dkg (dark grayish) tone respectively. Typical paintings and 
poster works from renaissance to modem are tested in this experiment shown in table 2. Figure 5 and figure 
6 shows examples of the paintings and the typical mapping result in the tone space respectively. We can 
evaluate the aesthetic impression of the paintings using figure 6 and figure 2. The extraction impression is 
listed as follows. 

“Mona Lisa” (2) of Leonardo da Vinci is famous for gently smiling lady. This painting locates near dk (dark) 
in the tone and gives dark, mellow impression. ^ 

Monet’s “Water Lily” (5) is said the mystic beauty of the surface of the water and is situated on the tone 
space near ltg (light grayish). We can say that the water lily has a cooled silent image. 

Gogh’s “Sun Flower” (8) is painted yellow strongly which he liked most. It is situated on the tone space near 
s (strong). From this result, we can evaluate that the impression of sunflower is strong, passionate painting. 

Figure 7 shows the mapping result of the works in table 2. The above-mentioned results agree with the 
established reputation and the eye inspection of human being. 




Table 2 Lists of Paintings and Design Pictures 





Pdnter 


Style 


Wctk 


epoch 
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Leonardo da Vinci 


Renaissance 


Virgin of the Rock 


1503 


2 


Leonardo da Vinci 


Renaissance 


Mona Lisa 


1503 


3 


Rembrandt 


Baroque 


Night Witch 


1642 


4 


Rembrandt 


Baroque 


Raising of the Cross 


1633 


5 


Monet 


Impressionist 


Water Lilies 


1903 
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Monet 


Impressionist 


Flower Pot 


1903 
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Monet 


Impressionist 


Pcpies 


1873 
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Gog fa 


Modem 


Sun Flowers 


1888 
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Gogh 


Modem 


SelfPortrait 


1889 


iq 


Signac 


Impressionist 


Saint -Trcpez 


1900 
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Renoir 


Impressionist 


Theater Box 


1874 


12 


Renoir 


Impressionist 


Les Grands Boulevard 


1880 


13 


Renoir 


Impressionist 


La Liseuse 


1876 


14 


Klee 


Modem 


Baldgreis(Seneao) 


1922 


15 


Matisse 


Modem 


Green Stripe 


1905 


16 


Matisse 


Modem 


Red Room 


1947 


17 


Munch 


Modem 


Screem 


1893 


18 


Munch 


Modem 


Sick Chiled 


1895 


19 


Poster 


Design 


Star Wirs 
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Poster 


Desigi 


Bug's Life 






Figure 5 Examples of the paintings 
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Figure 6 Mapping Result in the Tone (1) 



Figure 7 Mapping Result in the Tone (2) 



5 Conclusions 



We proposed the way of evaluating the beauty and impressive sense of the paintings and design pictures 
based on the tone in the Muncell color space. We use the tone space, which can concretely express the color 
impression and a corresponding systematic color names. This method suits the aesthetic impression degree 
evaluation by the computer because the evaluation processing doesn’t depend on the hue. 




After getting the image data through the scanner, we convert each RGB pixel the tone space in HLS Muncell 
color space. We extract the location of the paintings in the tone space by calculating the coefficient of the 
occupied area. The aesthetic impression is estimated by the location of the used color in the tone space. 

The famous paintings from renaissance to modem are tested for extracting the impression feeling. “Mona 
Lisa” of Leonardo da Vinci and Gogh’s “Sun Flower” is estimated as matured darkly and strongly passionate 
impression respectively. These results tell us that the distinction by the computer coincide with an 
established reputation of the paintings. 

The impression extraction by this way is useful for the students learning how to use color arrangement in 
their fine arts subject. 
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An informatization society, where high added value can be created through 
networks is different from an Industrial society where physical labor predisposes 
discrimination between men and women. As knowledge and information are 
regarded as the most important resources in an Informatization society, 
intelligence and emotional ability are given more importance than physical 
superiority. In light of this, the roles and positions of women are being newly 
evaluated, and the direction of the women’s informatization movement has 
emerged as a new topic of the era. Korea places a strong emphasis on education 
and the percentage of women who attend University is also high. Contrary to 
this, the percentage of highly educated women who become working members 
of society is very low. These days, this problem has been recognized and 
education in woman informatization has actively proceeded. Taking various 
kinds of women's organization as the principal axis, woman informatization 
projects are actively unfolding. Government has also explored supporting plans 
in various aspects. This study explores the present state of women’s 
informatization education and it’s future direction. 

Keywords: Woman Education, Informatization Education 



1 Introduction 

An Informatization Society is expected to be the 3F era: Female, Feeling, and Fiction. Productivity of 
culture.and emotions is more important than labor productivity. Instead of labor productivity, sensitivity and 
intuition unique to women are expected to contribute a lot to the development of an emotional business that 
has high added value. 

As the roles and position of women are newly evaluated, the direction of the women’s informatization 
movement is emerging as an important topic. As it becomes necessary to have women’s informatization 
education in Korea, a new movement has emerged. In light of this, this study will explore the present state 
and future direction of informatization education of women in Korea. 



2 Present State and Problems of Woman Informatization Education iti 
Korea 

The studies on women and the informatization society have been introduced in Korea since the end of 1980. 
Until now, works on the development of women in an informatization society have been produced 
intermittently. The Korean Women’s Association and National Women’s Convention has dealt with “Woman 
and Informatization Society,” and attracted the attention of the society of women overall. However, 
systematic, continuous and comprehensive studies on women and informatization have been insufficient. 
Also insufficient are the studies on the concrete policy alternatives for informatizing all women in 
accordance with national informatization. 
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